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IDENTIFIERS 

ABSTRACT * ^ " . 

The Louis ianli State Department of Education (LSDE) 
competency-based education and accountability effort includes, as an 
integral component, a Compensatory/Remedial Education PrograS/The ' 
primary' purpose of the program' is to provide special instruction to 
those students who fail ~ or, who are at risk to fail ~ to meet the 
state's minimum standards, as assessed by the upcoming Test of Basic 
Skills. The first year's implementation of this program consists of 
building a ^research database on a variety of compensatory/remedial 
instruction models for second-gradex?s at risk for failure to meet the 
minimum standards. Seventeen projects were awarded funding^ of which 
•^two were planning projects; 13 were pilot projects, and two were 
demonstration .projects. It is intended th^t this evaluation report - 
will provide information required to select the most promising of 
these models larger-scale implementation and demonstratipn . The 
two projects approved for planning and training of personnel excelled 
m precisely those ai»|ts, and seven of the 15 pilx>t*and demonstration 
projects dQmonstrated^t least suggestive positive effects on student* 

achievement ' i#t>n^e or mx^re^^ skMl areas. (Author/GK) 
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EXECUTIVE SUMflARY 



^Submitted b/. Bureau of Evjiluation, Office of Research and Development / 
Prepared by: • David L. Ransen, Ph.D. ' 

The Louisiana State Department of Education's competency-based educatiorK 
and accountability effort includes, as an integral .component, a Compensatory/ 
Remedial Education Program. The primary purpose of the^program is to provide 
•special instruction to those students who/fail - or. who are at risk to fail 
-- to meet th^ state s minimum standards, as assessed by the upcoming Test of 

DdS1 c Ski lis.' b 



The -first year's implementa.tion\of this program consists of building a 
research database on a Variety of compensatory/ remedial instruction models, for - 

^Qon"?;^!''''!^' ^""^ ^'^^"''^ *° ^^^^ the minimum standards. For the year 

1980-1981, the Louisiana State Legislature allocated $100,000 to eath of the 
eight congressional. districts to support the development of mode! projects. 
The Office of Research and Development drafted and sent requests for proposals 
to all local superintendents, inviting them to submit proposals for planning, 
pilot, or demonstration ^projects. . - ^ - ; ^ ^ . ^ »» 

The proposals received were\reviewed by a "joint Committee "of the Offices 
of Academic Programs and Research and Development. Seventeen projects were^ 
awarded funding, of which two were p.lanniflf projects, 13 were pilot projects, 
and two were demonstration projects. It is intended that this evaluation report 
will provide information required to select the most promising of Ishese models* . 
for larger-scale implementation arid demonstration. s ^juei^ 

.' ■ *> 

The two projects approved for planning and straining of personnel excelled 
in precisely those areas in which deficiencies tended to exist in the other 
projects: aaeq^uate planning and training. This suggests the arcument that, 
in the future, it may be wise to "allow projects to engage in a year of planning" ' 
and training prior to the implementation of a pilot project." It is the opinion 
of the Program Evalu^tor that "both planning, projects are well -prepared to 
initiate pilot projects. 

" .' 

Seven of the 15 pi lot -and demonstration projects demonstrated at least 
suggestive positive effects on §.tudent achievement in one or- more sl<i1l areas. 
Of these seven, five e\4idenced significant gains in all 'the achievement" ski 11 
Thnni , «^ and tested. No evidence was found that ' students ' Affiliation for 
school -was affected by any of the projects. 

Overall, results suggest that the flexibility built in to the Request ■ 
S^h ^h£°f?.^l had a favorable inYluence. By .encouraging diversity among- models, . 
both the LSDE and the participating parishes have acquired valuable information 
about the relative merits and. feasibility of a number of models.' - . ' 

. -f-bst of the parishes that experimented with computer-assisted instrukion or 
classroom management techniques experienced, a common core of difficulties' It ' 
appears that the state of the art in the use of microcomputers "t-n classrooms M- 

.J ^''""^^ operation on short notice. It should ±ie\ noted, 

'situafi-on .'hh"??^ comrnerci^l concerns are working very rapidly .to improve this 
situation, and it may be only a year br two before dramatic iniprovements Mve ' 



been achieved. 



Mo^t of the projects that emphasized individual ized .instruction showed" 
prorrns>ng results. These projects combined, the lowering of pupiUteacher ratios 
?f fc'nnf'"? '^*u-"u°t.f^?"?^*i'^/P''"'=''''P*^'v^ instructional techniques. WhiTe 
MJil rlL^^^l"^ ^'l ) °^ ^^^'^ components is the more potent. 

JJ^hLc ^T^^Iu'^^f *9 ^^^"^ P''°"'''^^ remediation- with high-ris4: second- • 
gradersj and further testing of these models is clearly warranted.. 

"The clearest lesson learned was that compensatory/remed-ial education ♦roqrams 
nnJ"hL-' ^T?^.^ *° ^""'^^^^^ ^P*^'"'^^ effectiveness when implementa??oTdoes 
?nJ ^p? Dc""*;! ^.-ir^ °' ^^^'^^"S'^ ^^-"^^ P'-ojects can-be faulted ' 

IZ nnl • J'^^^.w^^'e handicapped frbm the-outset by the fact that they 

Si^. Tf cf "^'^^'PP'°''^ ^f*^'' the beginning of the schW" 

fhfr'nni-/- junding IS to be forthcoming in- the future, it is suggested • 

oJ the sjJo" ;^ar ^'''''f ^'''^ ""^''^ *° ^thrb^fnning 
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Compensatory/Remedial Education Program (Act 433) . ' 

'final Evaluation Report 

-1980-198ij "... 

Submitted, by: Bureau of Evaluation, Offide of Research and Development 
Prepared by: David L. Ransen, Ph.D. 

. ^ ^ OVERVIEW • 
*The Louisiana State Departmejrt of Education's competency-based education 
and accountability effort. includes, as anj'ntegral component, 'the Cpmpensatory/ 
Remedial Educati^on .Program. The primary purpose of the program .is t^ provide 
special instruction to«thdse students who fail -- or,.-who are at risk to fail 
— to meet tl^^tate's minimum standards, as assessed by the\ipcomi/ig Test of 
ek^'ic SkiUs. . • ' • - * , 

The first year's implementation of this program consists of building a 
.^research database on a variety of coinp€nsa'tory/remedial instruction nfodels. for 
secopd-graders at risk^or fai:ij^re to -meet- the Tffanimum standards. It is 
intended that this evaluation report will provide informatipD required to select 
the most .promising models for larger-scale .implemenjstion and demons J:ration. 

^For the year 'l980^8r, the Louisiana ^ate Legi^?lature allocated SlOp^^O 
to each of the'eight'icongressional Vlistricts to support .the development' of model 
projects*. The ^Office of Research ahd^v^pnlent drafted and sent reqiies-ts for 
proposals to all iaca^l~srpeTintendents, inviting them to submit proposals for' 
planning, pilot, or demonstration projects ^Teeliexi section* for- definitions) * 
The proposals received were 'reviewed by a joint comnittee of the Offices of 
•Academic Progr-ams^and "Research and Development. -Seventeen projects were awarded 
fun^ingj of whicj^ two were- planning projects, -13 were pilot projects, and' two 
were demonstration |)rojgcts. • - 



. ' ^ Purposes 

The primary purpos^ the. 1980^1981 program was to generate promising 
strategies for compensatory/ remedial education by supporting- planning, pilot, 
and demonstration projects^ The projects '.purposes, ip tyrn, depended on their 
type: - . 

4 - * . • 

i 

^ ' ' • P-eonii^ng P/Lo'/&ct6 were to engage in intensive planning, research, 
and training of instrucfional personnel with the goal 'of readying ' 
a school district to implement a pilot project. • ^ * 

• PUot Jkoi&ctA were expected to experiment with novel prograirfs 
of compensatory/ remedial education, so that the relative merits 
of each program could be objectively evaluated. 

" ^emn6tA<}t^ n'.?/Loie.ct6 were tb demonstrate both the educational 
.•and cost effectiveness of instructional, programs that have already ' 
been piloted with success. Further, demonstration projects were 
' ^ to serve as models of portable and effective programs for other » 
school systems within the state to inspect and -possibly to adopt. 

Administration Procedures Adopted Bv The Department of Education 
The Department of Education (LSDE) has served two major functions w the 
Compensatory/Remedial Education Prograjn: a^miot^trative and evaluative. To 
this end,. a program coordinator vyas appointed by the' Office of Academic Programs 
and 'a program evaluator was appointed by the, Office of Research and Development. 
' ' As soon as the 17 -successful applicants were notified of their fundinq, • 
negotiation sess tons' were held between the Departin^nt and the LEA (Local -Edufcatit 
--Agency) project personnel.- Representing the' Department- W the. program coordi- 
, nator and the program evaluator. ^Each project was represented b) one or' more ' 
contact persons appointed by each local sup6r^*ntendent. The purposes of these ' 
negotiation sessions were: • * . - 

1) to clarify and document the respective ob]igat1ons^ of the 

• participating LEA and' th^ LSDE; • \ - • 

2) te assist local project [personnel with any anticipated problems; and 

* * * , - ^ ^ 

3) to request" revisions of 'proposals where -jiecessary. 

, ^ -The program coordirtato. and the* program evaluator h^ve maint^'ined close 

- ' V -2- o . ^ . 



. contact with local project personnel throughout the school year, and have 

e^ch conducted at least one onsite visit to all of the 17 funded projects. The, 
primary functions of the program coordinator were to e^isure that projects were 
bfting implemented as approved and as scheduled, and to provide assistance where 
requlested or requir^i. The ^program evaluator was to take whatever steps^were 
necessary to .evaluate each project properly *an*'objectively; These steps 
included ensuring thai al^quantitative and qualitative data were submitted " 
- by project personnef as required and in a tiii^y fashion, providing technical 
assistance in evaluation-related ^reas, and planning and executing apprjfpri ate" 
data analysis procedures ta evaluate the effectiveness d#each project at its ■ 
conclusion. 



V 



timber of- Participating Students 
The number of student^s directly served by the compensatory/ remedial 
. projects ("e'xp-erimenta ^groups") was 1850. A roughly equal number of students 
^ ("control groups") were not directly served but were tested and observed as 
a^ means of establishing benchmarks against which the effectiveness of each 
project could be assessed.. The average number of students served per project 
was k(l9. *' 

The number of students directly served represents almost a 100% increase 
o^er the numbers contained in the original .proposals 'as submitted to the.LSDE. 
..The LSpE negotiated this increase with representat>rcs from each project to. 
encourage maximum cost-effectiveness. Table 1 presents the number of students 
served, tl^e total allocation and cost per, student, the main program component, 
and a summary of significant findings for each project. - ' 
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. . Evaluation Plan 

i— A ..^ - 

The evaluation plan concerned itself with .botfr the process and products of 
^each project. BecatTse o> the large nunjber of diverse projects, no single pjan- 
• • ' -3: 
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Table 1 
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Project 


riain 
Component ^ 


Students 
Served 


Allocation 


Cost/Student 


Sigmficar.t P^5u.Us 
SOS Reading "ath Ydno 
















uage 






Pla9ning Projects^ 










Etst Baton Rouge 


EAR 


172 


$50,000 


S291 








Professional 
.Development Center: 
Bossier 
Caddo 

U 1 8 1 Durric 

DeSoto 

Red River 
^abine ' 
'Vernon ^ 
. ! Webster 


ECRI 

• 


72 


sso.ootf 

1 


694 ^ 
* < 


... 


... 


1 




* 


Pilot Projects ^ 










Acadil 


oir 


124 
81 


50*000 


403 - 


* 

nu 


.•U« 


no 


Bossier 


II 


*35!787 ^ 


442 


no 




Yes Yes 


Calcasieu 


CAI *■ 


131 


43.050 


329 


^ i«U 


Vac 

Tes 


No 


Iberville 


CMI 


loo' 


40.000 


400 


mO 


r«o 


No — - 


Jefferson 


M • 


n2 


I 49.8^1 


445 


*o. 


Vac 


YfS — 


Lafayette 


11 


91 


49.492 ' 


544 


tiO 


iJO 


No 


C^leans 


II 


144 


50.000 


34.7 . 


no 


no 


rio 


St. Charles 


CAI^ 


85 


i 46.911 


552 






Yes 


St. John the' Baptist 

* 


II- 


110 


^ 45.000 


. 409 


No 


No 


No \p 


St. Landry 


II * - 


130 


50.000 


385 * 


No 


No 


No . 


Tangipahoa 


II 


98 


47.675 


486 


No 


Yes ' 


No — . 


<i<est Carroll 


CMI/CAI 


^13 * . 


45.000 


398 


No 




Yes 


North La. Consortium 
LaSalle 


II 


102 ' 


50.000 . 


. 490 


No 


No 


Yes — 



Ofta Chita 
Caldwell 



Ascension 

St. Bernarcj.^ ^ 



eni 
II 



TotaT 



Demonstration Projects 
111 45»884 413 

75 50»000 . 667 



No 
No 



Yc$i 
No 



No 



Yes 



$^98,646 



i431.4^ (Average) 



1. 



2. 



CAI • Computer-Assisted Instruction - 
II • Individual iredtlnstruction 



3. 
4. / 



EAR • Extended Academic Readiness 
Dtl » Computer-?1anaged Instruction 

ECRI -txtmplary Center for Reading instruction 

Planning Project: -Plans» researches* and trains prior to the ihipmentation of a 
pilot project. 

Experiaints Vlth promising remedial education practices $0 that the 
relative merits of each a«y be objectively evaluated. 

Dtmonstratlon Project: D«nonstrates both the tducational and cost effectiveness of 
instructional programs that have already^been piloted with, success. 

N.l. Eapty cell Indicates subject was not tested or scores not reported. 



could- be deveWed to.evaluate the process of implementing each project. 
Onsitej Visits provided brief opportunities to observe project .implement^t^ 
first-hand, but the responsibility of documenting activities arid their impact 
rested primarily with the local evaluators of each .project. In sonj^ cases this 
documentation ml thorough and complete,' but in others it was lacking ^' 

. Evaluating the products of the projects was the primary responsibility • 
of .the-^tate Program Evaluator, who developed a product -evaluation design to 
be followed by all/Stit the planning projects. The evaluation conformed to 
a pretest-posttest control pup design. That is, a project was required first 
to select ft group of S^irdents who would" receive compensatory/ remedial services 
(experimental group), then identify another group of similar students With 
whom the experimental group could be compared before and after the^'npl ementation 
of the project. The purpose of the control group was to provid^ no-treatni^nt 
expectation of achievement progress; Ihat is, to estinate the-'ipected progress 
of experimental -group children had they not re-ceived any com/nsatory/remedial / c 



services. 



!• Major Evaluation Questions *' »• 

A. Questions Regarding Incflvidual Projects: Process 

1. -^Vfes each project implemented as approved and as scheduled? 

• 2. In cases wf|ere significant departures fro^y design or schedule 
occurred, how did these departures affect the outcomes? • 

3. What were the major strengths and weaknesses of each project? 

4_. How could the project design be strengthened in a future 
fmplementatiom' ' , , 

Questions Regarding' Individual Projects: .Outcome v 

1. Did Students receiving compensatory or remedial services demonstrate 
• • significant, gams in achievement and attitudes toward school, 

relative to comparable students who did not receive such services? 

B.> QuesttDns Regarding the Projects as « Group 

.1. How many of the projects demonstrated significant gains in 
achievement and attitudes toward school'? 

. ' -5- ^ . • . 



? 



2. What apparent chlaracteristics distinguished thd mre successful 
ZT M 1^^^ successful proj^ts? Are th6se characteristics 
amenable to mampulation in the future? . • - 

3. What general conclusions and recommendations can be.infert^ed 
trom the outcomes/of the projects as a group? • 

"II.. Sources and Xinds of Data ' . ^ " . . . 

Data for the^process evaluations were gathered exclusively from in'struments 
efnployed by ,the> LEAs-.y hese instruments va?ied greasy across projects. They. 
>angefl in number' from :one to' six. and in kind from dally l^gs to formal, question 
naires administered to teachers, parents, principals, and/or supervisors.." Onsite 
visits conducted by the LSDE program evaluator provided independer^t information- 
to supplement and verify the informatTOn received from the local evaluation 
instruments. ' ^ ' ' . ' " 

Dat^ for the outcome evaluations came from -three-sources : standardised ' 
'achievement testsl a standardized attitudeln^;entory and final budget reports. ' 
Achievement ^ains were assessed\by means- of the standardized achievement tests. 
Since most of the participating parishes already assess achievement with a test ^ 
0^ their choosing as .a matter of routine, the LSDE did not mandate th^e use of a " 
s-ingle.jest jn an ef.foH to avoid.multiple testjijg of the participating students.' 

The tests used were approved by the LSDE because they were deemed vajid for 
use ir> the present co^ntext and sufficient])^ comparable to each other. All - ; 
the tests used-have been empirically .validated wVth national -sYpl^s.' anJ^have 
been in use in Louisiana school districts for a number, of years (^ee Table 2- for 
nafiies of tests). Attitudes toward school were assj^sed in all cases by the Self 
Observation Scale (Primary Level ) . This instrument has been' elnpirically validated 
using a -large national sample (Stenn^r and Katzenmeyer! 1973). Finally, the *^ 

followinji additional, student data, were gathered; • > 

» ' § ' erthnicity ' ■ * ^ . ' ^• 

• ^ex ' ' . . . ^ 

• Title! status (Yes/No) • * 
lunch status (free, reduced rate, or paid) 

t grade level status (repeating or not repeating) 



\ 



Table 2 



Project 



Achieveaent 
Test 



Adjusted Staxidardized Gains 

Adjusted Gains 



' Acad'ia 

Ascension 
' Bossier 

Calcasieu 



2 . 



Iberville 
Jefferson 

3 

Lafayette 

HOrleans 
St. Bernard 

St« CharJ.es^ 



Coiap* ^ SOS, 

Exper.' Cent. 



Reading 



Math 



Lang. 



r 



SRA 
SRA 
SRA^ 
SRA > 
SRA 



CTBS 

SRA 

CTBS 
SRA 
$RA 



A 
B 
AB 



St. John the Baptist CAT 
St. Landry n v sRA 
Tangipahoa SRA 



N. La. Consortium * SRA i 1 

\ ^ '2 



,2:0 
2.3 
•11 



-7.0 



-3.5 



-0.6 



-11 



9.1 
-2.0 



-4.0 
-6.4 



0.7 
-3.7 



-12 



-5.2 
-9.2 
-4.2 

5.1 
-5.5 



-11 ^ 



Exper 
-3.7 

17 
. 4.7^ 
-6.1 



1.7 
17* 
13* 



5.0 
1.8 



12 
6r,6 

5^. 
7.6< 



2.4 
5.2 



C6nt. 
-0.4 

-4'w7 

*4.0 

-1.7 

-6.9 

.17 
5.2 

11 

- 2.2 

T^.7 
2.6 
0.8 



5.1 
-5.t 



Exper 
-5.0 



12* 
0.3 



-6.3 



13* 
17* 

-25*' 

3.8 
3.6 



15 
7.3 
6.5 
6.4 
>.4 
4.3 



3.0< 
7.9 



Cont, Exper. 



-3.2i 



-2.4 
-0.3 



6.0 
6.8 



14 



6.2 
-2.2 



-0.5 
1.1 



0.7« 
>3* 



5.8 

-dr9 

0.9 I 3.8 



Cont. ]f 

-8;6 
1.6 



1.7 



f 



* Indicates result in staAtsticalli slgnif leant (P<.05). 

i: ISxpressed in Korsul Curv< Equivalents (RCEs) , * 

2. MnUiple scores correspond to_ tceataents^, B, and AB (see text). 

, 3. Munij^^; scopes correspond tirvtrjeaoients one and two (see^ext). 

*^J^ltiple scores correspond to coBponents one and two (seftext). 

».B. Empty cell indicmtct that nibj.ct wa't not t.fttd or th»t fcortf 
were not «v«ilmblt. ^ 
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4 There were two reasons for gathering tfie latter.set of data. First, it was 
necessary tojnsure that students receiving special services were comparable 
to those with^whom they were compared with respect to economic and demographic 
characteristics. Second, where these two .groups > ("experimental " and "controf") 
were found not to be comparable, the availa'^lity of these, data permitted 
statistical adjustments to be made to simulate t^e comparability of the groups. 



Ill* Data Analysis * ' ' 



In an effort to'encourage innovati veness and diversity among the projects 
proposed for funding, th^ LSDE imnposed few constraints on the model projects 
As a consequence, there existed much variaHop in the. manner in which the projects 
were designed. For example, t^ manner in which students were selected for 
participation and allocated to eithei^ experimental or control groups varied con- ' 
siderably from project to project. Moreover.^the projects varied with respect 
to the number of students served."^ Also, the choice of academic skills (i.e., 
reading, mathematics, language)- was made at the discretion of each project. 

Data analysis was performed separately for each project. The technique 
employed to assess true gain was^n analysis of adjusted standardized gain scores. 
The adjusted gain score analysis' standardizes both pretest and posttest scores, - 
then computes the average gains for both experimental and control groups, then 
adjusts these gain scores on the basis of any prior differences between experi- 
mental and control group adjusted gains. The adjustmejvts in" -the procedure are 
necessary in orber to ensure that test score differe.nces are attributable to the 
compensatony/remedial services, and not simply to prior differences between ■ ^ 
experilnenttirand control groups. ^ \ 

\ 

The purpose of a control group is to provide a no-treatment expectation 
of students' progress. That is, a pretest-posttest control group (iesign, . 
when.properly executed, allows one to assess the effects of an experimental 
project by comparing students' progress with the progress on^ vrauld have 



expected.in' the absence of special treat,nent. Occasionally, one finds that , 
experimental and control ^oups are different at the outset with respect to 
either ^academic achievement or other educational ly.. relevant variables^. This . 
■means that.one ^roup cannot" provide a valid no-treatment expectation for the 
other .group, since any differences found at th^ end of a p'roject may b.e 
attributable to prjor differences, as opposed to the effects of the,project. ' ' 

rAlthQugh the statistical adjustments referredta above can often control 
for minor pre-project group differences, the va;i-dity of such adjustments 
•decr-eases as the disparity between groups indreases. For. this reason, cautionary 
remarks are'found in several of the project 'descriptions below. When phrases 
such^as "interpret with caution" appear in these descriptions, the intended 
meam-ng is that the results should be interpreted only as suggestive and in need 
of replic'ation: " . < . ' . 

The unit of measurement for analysis of achievement-gains was the normal • 
•clirve equivalent .(rCE). An NCE is a unit on a standardized scale that ranges in 
value from 1 to 9^. with a national average of 50. An NCE has the same magnitude 
regardless of where it .is located on the scale (unlike percentiles and grade 
equivalents which are not on equal -interval scales). ^ The MC^ was chosen by the 
Program Evaluator becaus4 it is the most suitable of the commonly used units for i 
computing pretest-posttest^ins in academic achievement. 



V 
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PLANNING PROJECTS 
East Ba'toiT Rouge Parish 
Des'cription and Process < '\k g •• 

* The Expanded Academic Readiness Program ir/East Baton Rouge Parish was 
approved as a planniiig project. Its primary goal was to' develop organizational 
structures, instructional strategies, and procedures as a prerequisite to imple,- 
menting a compensatory/remedial education project with second-graders.. • 
The Academic Readiness concept is built upon the^ notion that mastery 
. • learning is an effective way to enhance- the achievement of h^h^risk students, 
and that individualized instruction ts necessary to promote mastery: The mastery 
learning approach adjusts for individual differences in students' learning rates 
^ and styles by adding feedba^krcorrective techniques to regular classroom instruc- 
tiorvapd^y" providing additional instruction time for high-risk students. In 
other words, the special irmruction supplements, rather than supplants, regular 
classroom instrudtion. 

\ 

Although the project.was approved for planning, a large body, of students 
actually participated in the developmental stages of the prefe^. (no formal eval- 
uation or testing of students was required of planning project^s). Students were 
selected for participatiori on the basis of low apKievement test scores, teacher 
recommendation, and low scores on a locally-developed screening test. - 

The screening test was designed expressly for the purposes of this project, 
and it comprised the first major activity. It was developed by key teachers 
arid supervisors. The screening test was pilot-tested, and a f'creening test 
manual was written and disseminated to. teachers*. Al though "it is^premature to 
"assess the merits of this test, the process by wh^chjt was developed was very 
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thoroughly described and justified in the screening manual. . ' 

• The-second major activity was the develc^pment of an inservice training ' 
program ^fap^achers, A'total of 48 teachers in 18 schools were involved in, . 
this.stage of" the project. Five full-day training sessions were conducted.' .The 
goals of these sessions were as follovis: 

D- To impart a general understanding of the nature of the 
planning project; • ' , 

2) To aqu^int teachers fully with the screenina test and 

manual; ^ - ^ . . 

•3) To import the training required to conduct'the pilot 
testing of the screening test items; 

'4) To provide a forum for assessing the reliability of ~- ' 

* ' screening test administration; 

y ■ ' 

5) To train teachers in the skills required to keep proper 
records and ta correlate the results of testing to the 
instructional 'materials available to them; and % 

6) To train teachers thoroughly in 'diagnostic-prescriptive 
instruction techniques. . 

These sessions took plabe- and the. activities were fully documented in the final 



project report. 



The third phase of the project involved the actual development of the ' 
Extended Academic Readiness model .irr selected schools.' Once studeats had been 
•selected for remediation, the' diagnostie-prescripti ve teaching procfedur^s were 
implemented. The deficiertcies of each student were charted, and individual lesfon 
plans were developed based^on each student's deficiencies. Then students ^^ere ' 
grouped according to their needs', so that each grouEJ^s relativeirhomogeneous' 
with respect to skill mastery. -Instruction was then given to these groups within 
their. regular classroom. Condurrent with\hese activities, the teachers received 
formal and informal inservice trai^Yg and were observed by* supervisory personnel. 

In conversation with^the Program Evaluttor. the teachers appeared to have ' . 
been suppartive of the prepepts of the project. Some dissatisfaction was noted, 
^ever. with respect to it^M•mentation.• Some' teachers'said th^t they were ' 
not adequately prepared to accept another instructor's presence in' the classroom. 



Experience in other projects has revealed t^hat this can be overcome wi,th suffi- 
cient' pre-service orientation and careful [pairing of, regular and remedial teachers. 
Afurther source of dissatisfaction noted by the Program" Eva lu'^or was the pupil-^ 
teacher ratio: Some remdial teachers believed that^hey were being asked to 
work witi)^too many children at a given time, and that this had the effect of 
undercutting some of the m^'ts of individualize.d .instructio~;i. Discussions 
with project supervisors indicated that these problems havg'been recognized 
'and accorded due attention. 

Conclusions 

Although no formal instruments were employed to evaluate the impact of 
this project, the documentation provided suggests that considerable -effort was 
expended. Informal observations and conversations led the Program Evaluator to 
•believe that much of this effort bore fruit. According. to the teachers and 
supervisors, many teachers are novy trained either, in the use 'or understanding-of ' 
academic screening.jekTlls grouping, and diagnostic-prescriptive instruction. 
A screening manual has been given a "dry run." and information necessary for 
its. enhancement was acquired. In general, the project appears to have completed 
its. planning objectives and appears ready for pilot testing under more rigorous 
evaluative conditions. 
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Fdurth District Educational Consortium 
. - (Caddo Parish. Fiscal /^egt) 
§escription and Process 

Consortium cbnsisting of the Parishes of Bossier. Caddo', Claiborne, Red 
River. DeSoto. Sabine. Vernon, and Webster was funded to conduct a planning 
project. The primary aim of "the project was to train 16 teachers in Caddo Parish 
in the use of the methods and materials of an instructional system called ECRI 
(Exemplary Center for Reading Instruction). A secondary aim was to arrange and 
cover the expense of importing teachers from the other parishes in the consortium 
■ - ' -12- 18 



to observe ^the conduct of the ECRI classes. / . ' 

The ECRI system was not well -explained in the Consortium's reports. How- 
ever, onsite visits provided some insights into its characteristics. The 
teaching style is highly structured. Virtually every pedagogical move *is 
dictated by the training manuals. The only^ notabl^ di/ference in the teaching 
behavior of teachers was the degree To which they had fully menorized and ' 
mastered the rules to be followed. 

The typical instruction session consists of rapid-fire introduction, ^ 
repetition, prompting, and correcting behaviors on the, part of teachers, and 

highly routine responses on the part of students. Each 'lesson differs only 
... > 
in content, but all foMow the same format. ^Based on preliminary observation, ' 

it would appear that the. primary strength of ECRI lies in its effects on students' 
time on tasR: The very high, proportion of time spent attending and Responding 
to the teaching was striking. During the time in whjch high-risk students 
were involved in an -ECRI lesson, the remainder of the class was moved to the " 
opposite corner of "the classroom, and was assigned quiet work.- 

All the participating teachers concurrently were receiving training in ECRI 
from outside certified ECRI instructors. However, this training cannot be dtfhe 
in^a few short days; Consequently, the teachers, began inplenpnting the instruc- ' 
tional .system well before, they had demonstrated mastery of the techrji^y^s (mastery 
was assessed by means of an instrument developed by the ECRI consultants). AJ,^ * 
the end of the school year, all of the participating teacheTThad demonstrated 
• . mastery of ECRI techniij^es, as assessed by the ECRI cohsultants. ^ In addition,' ^ 
^ seven of the teacher^sufasequently enrolled in a summer session university course 

on ECRI. ' Thus, all of the participati^ig teacher^s are ejjpected to be ful'ly 
- ^ prepared to implement ECRI met^ds' at full strength at the beginning of the next • 
' school year. • r . • 

■ No formal instruments were employed to evaluate the strengths an^ weaknesses 
of the project as, imp! emented in the Consortium. Some informal surveys were 
ERIC , ^"^"^ the staff, and, the responses are described as largely favorable. 



Neither were thfe reactions of the visiting educators from the Consortium "formally' 
assessed, but their reactions were described as nixed. 

• conclusions 

Jfie Consortium's final report cortcludar that ECRI techniques were d6mon- 
strated to be- effective. The Program Eval-uatqr cannot point to any;enipi<.ical 
, support for this claim. The local evaluation did include an analysis ^f standard- 
ized pre- and posttests (although these were not required of a planning project). * 
^ but the abseace of information about the experimental design- and the participating 
students, together with the failure to report t^e results in a form suitable for ' 
valid pre-post analyses, precluded an independent statistical evaluation of these 
r^suTts. According to the locally prepared evaluation, no significant test score 
gains were found. » 

* 

. , In sum. there is> little doubt that one objective of the project was achieved: ' 
16 teachers were well-t^:ained in the use of ECRI. Uilf/rtunately. that 'is the sole ' 
conclusion that can be jJstifiefi- in this report. It remains ^o be^seen whether 
the project can beeffective in enhancing the ability of teachers to address \ 
•successfully the needs of students at risk to faifto meet minimum standards^f • « 
academic performance; "^^X^ " 
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^ • PILOT -PROJECTS ~ . 

. ■ • ' V Acadia Pa rish' 

•Description ahd Process . * 

3* ~ - - > , 

, The pilot project implemented by Acadia Parish was ah' experiment in Com- 
puter Managed Instruction- (CMI). One hundred tewnty-four experimental and 100 
contrf^tudents were' selected for inclusion on the basis of previously poor ^ 
performa^e on tests and' on teachers' recoimendations . 

The)primary aim of the CMI ^project was to free teachers from some of the 
tedious, but important, work attendant t^ diagnosing students' instructional ^ 
needs and prescribing instructi6nal strategies in th^areas of reading aVid mathe 
matics,.' Specifically,, the project contracted with a vendor to provide the 
following automated services: • * - ' • 

^ 1) j:ompi ling inventoHes' of prescriptions; 

2) reporting formative test results; ' • ' 

3) generating individual student profiles^ - . 

4) generating class profiles; . ■ \' ' 

' '. ■ ' 

5) identifying of additional instructional resources; ' 

( ' " ■ . ' ' ' 

6) reporting of mastery test resul1;s,;- 

9) simplifying reports to parents; ^ - l 

, % - ■ - 

10) developing' test item analysis reports; a^d" -» 

11) generating administrative reiports. ' ' 

A secondary aim of the project was to enlist parent support by Involving' 
them in workshops and by provlding them with computer and narrative reports 6f 
their children's progress. The project as proposed ;was_ to include formal evalua- 
tions of thk reactions of participating staff members and pareats by mear)s of 
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questionnaires. However'^ no suc{? 'eval uations;were''r^po\d project personnel. 

Onstte observation revealed several important djicrejJatiti'es between the ' v 
■ activitiestplanned and those actually ifhpleraented;. as well" as some problems with 
those activities that were implemented. . ' 

First, a computer software package .that w^s'to ha'ue Enabled a local CMI 
function was not delit^ed by the contractor, and" hence was' not implemented 
during ^he school year. Instead." "test scores had to be sint to allocation ^ ' 
in a neighboring parish for:eiaaTy|is. atid the .Vesulting reR,6rts arrived at bi- 
weekly intervals in.Atadia. ,The feeling expVes^^d ty tht participating teachers 
was that the reports were arriving too l^{e »nd too infr^equerrtTy ta^be of much 
service to them. '« - ' ' 

• Second, fhe teachers complained ''that the, computer reports they received 
were either diffi^lt to interpret." highly repetitive,' or nof r^evant to' the' 
specific \eds involved in remediation o.f the-pffrficipating stulnts.. Th.e^ . 
opinion of the Program Evaluator is that these-complaints wer/largely justified. 
It appears 'that insufficient attention was paid tS th§ coordination between' 
what the teachers needed and what the cantractor Was providing.,. ' ' / ' ' 

Outcome ^ . . ^ ■ . - <i - y ^ 

No significant differences wereCun'd in performance 'between the experimental 
and control groups in any of the tested 'areas. Tabl^ ^ lists the adjusted stand- 
ardized gain scores for all tested areas in this^and all other projects. The 
experimental group's adjusted gains were negative in direction, indicating that 
their performance relative to national norms actually decljned slightly during ' 
the course of the school year. i " 



Conclusions \ ^ ^ 

•■ The process and fyjd^ducts of ^his program, were not. encouraging. . Some 
important components of^|:he project were either not implemented oi^implemented 
in an unsatisfactory manner. It isjlikely that these deficiencies wece respon- 



sible for the, students' lack of progress, as assessed by standardized tests. • 
This may meap'th^t the concept of computer-managed instruction was not afforded 
a.fair*test in thivs^projeet, .so it would be premature to ipfer that CMI has: ' 
no place -in compensatory/remedial education. 

Projects of thfs nature could probably benefit in. the future froin^me 
of the experiences in Acadia Parish. It would appear that the timeliness of 
CMI-generated reports is crucial, and that late reports ^verely^ restrict 
teachers ability to respond-appropriately to the assessed needs of their 
•students^ Morewer. the repoVts should be tailored to the teachers -perceived • 
needs. In particular, the number, formats, and kinds of reports should be ''' 
determined l)y instructional personnel, and only th,en communicated to those fn 
charge *of operating the computerized system. ' 

Bossie r Parish 

Description and Process 

Bossier Parish's "Achievement Plus"'pilot project -was designated to foster 
growth fn language arts afid mathematics among high-risk second grade students 
and to help them to build nxj re pbsjtive self-concepts by providing frequent 
experiences with academic success? 

0 

Project developers proposed to maxtfnize the individual attention afforded 
to students by piyc'ing them in small classes. In addition reading instruction, 
was structured with the aid of a basal reading series and mathematics instruc-"" 
tion with a basic. developmental program of skilTdevelopment exerci^sps.' 

^ Project personnel attempted to involve parents, by sending progress reports 
and concJticting some group Conferences. However, the project did not include 
an evaluation of the impact of the parental involvement component. 

Students were selected for incljdsion°in the project on the basis of seven 
criteria: -* • , ^ - ■ 

1) grades achieved in language arts and/or mathematics; 

2) scores on criterion-referenced teSts in the%bove. areas; 
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3) achievement on SRA Primary Mental Abilities Test; 

4) degree to which demonstrated mastery of skills fell- 
short of those listed in the Louisiana Minimum Standards; ' 

5) teacher recommendation; 

6) *regularity of school attendance; and , \ 
^7) absence of Title I services. • ' • 

Instruction in language arts was structured bj' Harper and Row's Readi 
^ Basic Plus series. This is a developmental reacting program with a carefully | 

'■ planned and double-checked pattern of consistency in the sub-areas of vocab- 
uWry, phonics, sentence analysis, comprehension, and study skills. Skills ^ " 
we^e introduced, reinforc^ed and reviewed at regular intervals throughout 'the ' 
project peciod. Supportive materials' for the series included a teacher's 
manual, skills workbooks, phonics workbooks,' duplicating masters! diagnostic'and 
mastery tes'ts, alphabet cards, "sound and word cards." langtiage ch\ts, and- ^' 
in'dividual record- keeping cards for recording student progress. I^n addition.' 
some audio-visual media were employed for teaching and reinforcemeut • 

Instruction in mathematics was structured" by the'Laidlaw TlHhematics Program 
with supplementary practice provided by wonRsbeets and the Spectrum Mathematics .. 
Series.' Emphases were placed on numerations mea'surenient, problem^ol ving, and ' 
basic computational skills. A few problematfic issues came to light as a resOlt 
of a).irregularit;[es in Meet design, and b) implementatioMeficiencies 

observed onsite. 

The design of the project was highly irregular from an evaluation perspec- 
tive. One'^roup. of students received enhanced instruction in language arts.'.^nd 
an equal number of students serve/as contrbls with which the experimental ' 
group could be compared. Additionally, a group of students received enhanced" 
matflematics instruction, and they, too, were compared with a controq/group. The 
prolecTl reports indicate that some students 'received enhanced instructiotT 
in tJQth areas; some in one area but^not the other; and some in neither area. 
Further complicating the design is the fact ttfat an experimental mathematics 
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student could simul^eously be serving as a control reading student, and vice-. 

verss. finally, the reports do not assign either status Lo same students 

who were tested. * t ' • ■ 

These irregularities not only make for a complicated analysis 'problein, 
- but also cast doubt on the validity of any findings resulting from statistical 

analyses. The outcomes 'of analyses reported below, then, should Ve interpreted ' 
. with caution. , ' ^ ■ ' 

. ^ As-^was the case with most of the other'projects, the single most debilitating. 

^ problem for this project was the insufficient lead time given to project' planners 

prior'to the onset of the school year. ' This problem, in turn, resulted in the 
- perception by both project personnel and 'the Program Evaluator that teachers. 

Ulferelinsuffici^ntly trained in the use of the instructional series. Further, all 

pannes agi:eed that ^he.time period between pre and.posttesting was undesirably 

short ]less than six months). 

Although experimental and control students received instruction employing 
different curricular 'raaterials,' project personnel frequently emphasized - both 
in reports and in conversation - that thejr pri^'iary op:feitni^ was grounded in 
the low (10 to 1) pupil-teaclier ratio afforded the experimental students. The 

• Program Evaluator' foun^d tf{is puzzling, sihce it was learned that virtually all 
second graders in the parish are afforded similarly low'pupil-teacher ratios. 

...Wien questioned about this, project personnel conpeded that, although they were 
very^opl^mistic about the prospects for progress among the second graders, they, 
did not expect significant differences to emerge between experimental and co'ntrol 
students. Jt liius appears that the use of control groups in experimental studies 
was not well understood by project personnel. ' . 



Outcome 

Experimental group gains were significantly greater in language and mathe- 
matics than those of the control .group. Analysis of the School Affiliation 
scores revealedjig significant gains {Table^2}. 
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Conclusions ' ^ ^ ' 

^The results of the statistical ^nalyses-indicate that the language arts . 
and mathematics scores qf experimental students slaved significantly greater • 
•gains, on the averageVthan did ^hose of the control students.. Conclusions 
drawn frc. these analyses must be tempered by cautfon.' however, for the reasons ' • 
stated abov^. Clearly, the superiority af the experimental group's gains can- . 
not be aUributed to tiie low pupiT-teac)^.r ratio; becau^r the' control students 
experienced. equally low ratios. .It is likely ^hat the intensive, structured 
instruction and practice afforded experimental students" had important effects 
on their progress. This would^eem to be the most plausible conclusion, buf''^^ 
one cannot place complete- confidence in' it. The teachers select^ f^or instructing 
the experimental students were described 'as master teachers, and onsite discussions 
indicated that project, personnel were highly supportive of the efforts of tho^^^ ^■ 
teacher^^. These two facts alone aj:girgu ably sufficient to have ;esulted in the 
Observed gains. * 

The most prudent conlusion. in sum. would seem ^o,be that experimental . '"^ 
students in Bossier Parish's project probably b^nefit"ed frqm something, but only 
a more- careful replication of the project can t^ll us de^nitively which facto^s . 
were in fact the most valuable for these second graders ^ * f 

Calcasieu Pari <;h 
Description and Process ' / 

The pilot project implemented by Calcasieu ParishLs an^xperiment in ' " 
computer-assisted- instruction (CAl^).- By giying each participating child Access ■ ' 
to a structured series of drill experiences via online computer terminals . it ^ 
was expected that performance in'readi'ng and mathematics wdu1£ improve among ' ■ ; 
high-/isk second-graders. . ' ' - ' ' 

^^'^^o^-to selecting the participan'ts..inservice training was /^ducted to ' - 
famil iarize teachers and principals with thp CAI programs and .its principles: 



Next, students were selected for participation on the basis of .prior test 
sco.r-es and teachers' recolnmendations.^ One hundred twenty-nine, experimental and 
131 control students were identified. Efforts to match the two groups were 
quite successful, with the exception that-the experimental group contained a 
significantly higher proportion of students who .were currently repeating second 
•grade.' . • , . 

By the time a site was prepared for installation of the terminals and a 
proctor was trained to supervise the use of the.tenninals. it^was near the end 
of January before students actually^ began to use the CAI progr^n. This means 
that the actual duration of compensatory services was only four months, a period 
not generally considered sufficient for significant gains. Because of physical 
limitations, it was deemed necessary to house the terminals in a central location, 
and to move participating students to that location at regular times for their 
CAI sessions. The location was well^prepared and was characterized} by a pleasant 
atmosphere. The enthusiasm with which students participated in the CAI left 
the Program Eval.uator with the opinion that the CAI activities had strong jnotiva- 
•tional properties. 



Outcome • ' 

Despite the rather short duration of actual CAI, experimental students 
showed significant progress in reading, relative both to the control student* 
anfi^ to national norms. No significnat gains were 6btained in mathematics 
achievement or in school affiliation (Table 2). 

Conclusions ^ - " 

The finding that significant, ga.ins were found in i^^ading but not i{i mathe- 
matics is particularly interesting in light of the fact that the promised reading 
software package was not received by project per^nnel . Much staff time v^ent into 
p»*epar1ng students .and staff for the use of a substitute package of considerably ■ 
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less face value. This may lead one to speculate that the extra attenti( 
given to the problem of overcoming a logistic problem in the reading area 
may h.ave had an impact on student progress in that area. In any case, the 
results in reading are encouraging, and suggest that^e CM„cipprDiu^p44ot€^- 
in Calcasieu merits implementing at a larger scale for the purposes of xlemon- 
stration. 



Iberville Parish 
Description and Process * 

The pilot project implemented by Iberville Parish represented an experiment 
n developing a maximally/ efficient system for providing j'ndividual ized remedial 
services to high-risk students. As proposed, the project was to make use of a ■ 
commercial computer-based classrobm management system designed to identify 
deficiencies and suggest prescriptive action for remedial teachers. The vendor 
of this system. Science Relearch Associates, defaulted on its delivery date, 
and Iberville Parish had not received the software as of the end of the school 
^ year. Th^situation was doubly troublesome for the project: Not only was it 
necessary to alter the project in mid-stream, but also the computer hardware 
already purchased lay idle after having drained funds that woulcT otherwise 
have been available for useful purposes. ♦ ' 

Despite this very serious handicap, project personnel shoJed admirable 
determination to "make do." In lieu of a computer, a clerical worker was 
employed to manage the collection of formative test results^ compile the results 
and organize them in useful ways, and correlate observed student deficiencies 
with available curriculum materials. 

In addition to the clerical worker and eight regular classroom teachers, " 
the project involved two classroom aides and a classroom management specialist. 
Both the aides and the specialist conducted individualized -instruction daily, 
during regular class periods. Each participating child received approximately 
^ - 5 hours peisweek in individualized instruction. 
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One hundred eXpenraen,tal students and 46 cLtrol students 'were selected on 
. . the basis of prior retention, low achievement ...t^'fer recommendation, and 
• . eligibility for Titfe I.' The experimental and contrU groups were fairly 
"w^n -matched with respect to demographic characteristics, although the. 

■ /-experimental group showed slightly higher pretest scores than did the control 

■ group. ■ ' • , ° 

Because of the mid-cours£ alteration in project plans, the aides and pa rii- 
cipating teachers did not receive as much inservice training as was planned. 
On the basis of observation and discussion, it appeared to the Progr&n Evaluator 
' that the degree of coordination among the staff affej-ted by the project, was 'less 
• than would have been.achieved if^sufficient planning and inservice training time 
had been available. In sum. onsite observation^suggested that the classroom 
^ management system was not well-oiled, but also that th^dfetemi nation and morale 
of participating staff remained high. " ' 

Outcome - 
. . The project ^cannot be called successful, in terms of the test scores. Both 
^ - aj^erimental and control students evidenced mean declines in all areas relative 
to national norm.s although the scores of experimenta^l students declined slightly 
, : less than did those of control students. Nevertheless, the adjuSted'gain scores-^ 
|| > were- consistently negative in .direction (Table 2)! 

Conclusions ' 

It is of course impossible h infer the true value of the comput^'r-based . 
management system as proposed, because it was never truly implemented. All that . 
, can be inferred\is that the activities that actually took pUce were insufficient 
in quality and/or duration to effect an av^rdge increase it, the tested ability ' 
of the- group of students involved. • ■' ■ 
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Jefferson Parish " • ' ^ 

Description and Process • ' • " 

Jefferson Parish's ^"Project Impact" was- a pilot project impleinented tin 
seven schools. Its aim was to provide additional instruction to 112 high-risk 
students in th^e areas of _ reading, language and mathematics. Three experimental 
strategies were employed,; ^ / ' ^ 

ifi-school tutoring by a paraprofessional . 5 days per 
week, 16 to 1 pupil -teacher ratio; / 

2) . Treatment B: after-school tutoring by a certified teacher. 3 days - 

per week for 45£minutes/8 to 1 pupil -teacher ratio: and 

3) Treatment AB: both of thee above components. ^ 

A^committee of professional personnel reviewed the current performance of , 
each student and prepared. an individual remediation program that addressed all 
the basic skills criteria and developed a priority list of those objectives that 
required mastery, reinforcement, or introduction. The ^im was to provide addi- 
tional instruction in those areas not mastered during the regular classroom 
time. Additionally, parents w|.re kept informed of their children's performance 
by means of weekly progress reports and three meetings with participating teachers 

Students were selected as follows: ^for each of th^ seven treatment schools, 
a control scjjool was identified whose student characteristics, closely resembled 
its treatment counterpart-; Then a random sample of 16 students was drawn f rom - 
each of'the treatment and.control schools. The control schools were not informed 
of 'the names of the* 16, control students. ^ . . " * ■ 

_ Instructional activities for Treatnent B (afteKschool instruction) consisted 
of one hour every Tuesday, Wednesday and Thursday/ Fifteen minutes were allotted 
at the outset^f each sess-ion for the students to "get-^qed." Instruction • 
•time was devoted equally to reading, language and mathematics. Parents'* were 
informed weekly as to theij" children's progres-s, and frequent corrmuni cation was 
maintained between the remedial and the regular classroom teachers in order to 



ensure continuajl updatihg of each student's individual learning prescription. 
- Treatments A (^-school) and AB were implemented in a similar manner. 
The in-school tutors attempted-to provide their service with minimal disruption 
^ -of classroom activities, and appear to have been successful in this effort. 
Thfr three meetings involving the profej|ionals a'hd the parents were " 
evaluated by asking both groups tS"complete formal questionnaires to indicate 
their reactions to the project. The reactions of the parents who responded 
were almost uniformly positive in tone. Professionals' reactions were also 
very positive, with the exception of some after-school teachers who complained / 
that both they and their students began to experience fatigue as^the project 
neared completion. The reactions of schoo> principals were also/solicited. and 
the principals responded very positively to the project as indicated by letters 
from them appended to the project's final report. ^ 

On the basis of both the information alluded to above and onsite visits 
■by the Program Evaluator. it appears that the after-school component (B) could 
benefit significantly through the more careful selection and training of parti- 
cipating teachers. Better selST^ould identify those teachers who possess 
the most energy to function well after regular school day. and better ^training 
would equip. them with some'special skills that may be he-lpful for such a unic^je 
assignment. Another enhancement might entail the invitation of parents to observe 
the after-school sessi'ons from time to time. 

« 

Outcome 

Da^ta analysis revealed that in reading, the adjusted ^ains of students in 
Treatments B and AB;were significantly greater than those of the controls. In 
other words, children receiving after-schsol instruction benef ited^easurabfy 
from the project.. " In mathematics, all three treatment 'groups 'showed greater 
adjusted gain scores than did thecontrol grotfp. No significant findings 
emerged with regard to school affiliation (Taible 2). 
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Cooclusions _ . ' , 

. There is fairly strong evidence that the inclusion- of high-risk second- 
graders_in the after- s choo 1 ' prdgram was effective in increasing their achievement 
In both reading and mathematics.. The evidence is more equivocal in the case 
of the in-school treatment. Before inferring, however, that after-school inter- 
vention is more effective than in-schobl . intervention, one must consider that 
providing instruction after school is Rrobably a hardship for the average 
teacher. A teache^ who volunteers to work long days may well be more dedicated » 

• or have more confidence in the, value of remediation, than one who chooses not to. 
Further trials are necessary to disentangle the .difference*^ in the strategies 
from differences in the personnel who implemented them. . ■ 

* Lafayette Parish 
Description and Pi^ocess 

The pilot project. implemented by Lafayette Parish was designed to enhance 
the achievement of students who had been retained or who were deemed likely to ' 
be retained this year through the addition of a certified teacher to the 
regular classroom. Once retainees and^students at risk foAetention (according 
to teachers) had been identified, they were allocated randomly >it,to three 
groups: Treatment One. Treatment Two. and Control, "with some small disparities', 
the three groups were in fact comparable at the outset of the project. Students 
numbered 44. §0. and 37. respectively. ' « ~ ■ 

Treatment One consisted If individualized instruction for a SOnninute ^riod 
each day. The instruction was diagnostVprescriptive in j^ture: that is. it 
was based, for each student, on his or her defictencies. The remedial specialist 
worked closely with the regular teachers- to coordinate their activities. In 
addit4on, the specialists solicited parental support by conducting three 2-hour 
evening workshops - duri nj j^hich suggestions were made as to how parents might 
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reinforce their children's .learriing in the home setting. Both the 
specialists and -the regular tfeachers were trained and given ongoing support 
by two members .of the faculty 'pf Education Department at the University of 
Southwestern ^Louisiana.' A close wtffking relationship among the^se parties 
was onepf the goals of the project staff, and informal observatTon indicates 
that such* a rajationship wa? established. 

. Treatment Two consisted of instruction by an added teacher for the same 
period of 50 minutes each day. Howe%, the instruction was not diagnostic/ 
prescriptive in natufg. Ratlier, the eVa contact time was devoted merely to 
reviev^and drill of the subjects and skills taught by the regular teacher. In ^ 
esse.nce, then, Treatment Two might be termed, "more of the same. '^^ The inclusion 
of this treatment was deemed necessary. in order to disentangle the effects-;/^ 
increased teffcher-pupil contact time from those of structured diagnostic/pre- 
scriptive instruction. Should no difference be found between thes^ two groups, 
the inference woujd be that the extra attention is sufficient. Should the 
Treatment ffne students outperform the Treatment Two students, the inference 
would be that the particular method of instruction employed effected^hange 
^•■beyond that caused by extra instructipn time. The Control- Sroup, of course, • 
received no special treatment, and its purpose was to contrast both treatments 
•with' no treatment. ' ■ - *' 



Outcome 

No-statistically significant differences were found among the mean gain 
scores of the three groups in an>k of the tested areas. In fact, there is a 
suggestion.that bolifi treatment grpups were outperformed by the control group, 
although -all three groups showed small gains (Table 2). Scoring delays pre- 
cluded an analysis of SOS scorl^hange/\ 
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ConcTusions . f ;^ 

The failure of test spores to demonstrate* pro jec|'effectiveness is - • 
. particularly striking in the case .of Lafayette. On the basis of both repor^^ 
submitted and onsite visits,- this project appeared to be well-conceived^and - 
well-executed, and technical expertise was read'ily "^vialable. Moreover, 
testimonials indicated that the project enjoyed the support of principals and 
parents. In sum,\^he ingredients for success appear to have been present. 

The local project evalua tor expressed the informed opinion that treatment 
versus contrbl differences' were'obscured because of the unusual progress made ' 
by^ control group students. She places this phenomenon in the category of a 
John Henry effect, which refers to the poss-ibility fhat a strong and positive 
competitive spirit was induced among the teachers of corfftl.^group students, 
which, in turn, led to a marked performance gain among that group. Although 
'such a gain did occur, it is not possible to confirm or refute this explanation; 
..one can- say only that it is plausible on the basis of evidence in- the compen- 
satorj' education literature. 

The local evaluator is, currently compiling data on all second-graders com- 
parable to "fRose-who participated in thejroject, sojthat the two treatment groups 
may be compared wijth a broader 'cbntrol group from other schools;,^ »the parfsh 
.-- schools wherein the teachers had no knowledge. of the project. ' Until a subse- 
quent analysis is performed, however, one cannot term the proje/t a success in ' 
terms of relative achievement gain. 



Orlean s Parish 

Descriptijpn and Process 

. The pilot project ^•mpl'ejnented by Orleans Parish represented -an attempt to 
J enhance the achievement of high-risk second-graders through the addition of basic 

skills 'special sts to regular" classrooms . Four such specialists served 103 
experimental children. - * '•• . 




The experimental students and an equal number of control students were 
selected by randomly dividing into tWo groupsj^ll second sradersat four 
schools whose prior achievement test scores fell at or b|ow the 40t* national" 
percentile. In fact, .the allocation produced two groups'that were well matched^, 
on every measured dimension- excep^ pretest reading scores, an whic-h thee)«peri- 
mental group showed superiority. . ' 

Prior to impfementation; the basic. skills specialists and the regular/ 
teachers attended four woVk^hops designed ta! train both. groups i^remedi^atj 
-work-in co-teacher situations. The impact oT each warkshop was assessed by 
means of formal questionnaires completed by a^-participants, 'and the results 
indicate very positive reactions to all four workshops. ^ 

In practice, the teachers and the specialists we're expected to engage in 
team teaching. The specialists worked 3^ usively With the high-risk students, 
whne^the regular teacher instructed the entire class. Each pair of teachers ' 
met weekly to coordinate their instructianal activities and to compare notes V 
the progress of project -students. According t6 the results of ^'questionnaire, 
both -types -of teachers reported fa^?orable reactions toHhe team' teaching approach, 
l^owever. the results indicated that some problems were ,.experi,enced in accessing 
instructional materials fgr the project, because of shortages and the absence . 
of a central location for their storage. • ,. " . 

In^addition to their work with students, the special ists ^attempted to gain 
the support of parents by communicating with them by mail and by conductiris ' 
monthly workshops with them. The paTint attendance at .these workshops was 
typically low (many were workiTig full-time), but surveys completed by those who ' 
^d attSn^i were positive in tone. Attempts to induce paVents^o: volunteer 'their 
assista|ce in* class met with very little success. , 

Like most of the other projects, this one, was plagued by a late start-up 
time. Instruction did not' begin until FebruaryTand posttesting was conducted ^ ' 
in late April. This period is g'enerally regarded as too short for signifijcant 
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•gains to occur. . Although the project manager was not notified of state 
funding until after, the beginning of th'e school year, a -substantial portion 
of the delay in implementationi^can' be attributed to managerial problems. ' 
One problem was that a local .project evaluator and design consultant were 
noi- desig^ted unitl February. Another,, mentioned above, was the difficurty 
experienced by teachers in obtaining necessary instructional materials. In. 
.general, the ^Program Evaluator gained the impression that it was not until - 
February that tbe project began 1;<o function smoothly. ^ 



Outcom^ 

An analysis of adjusted gain, scores revedled no significant differences 

between experimental and' control students, either in achievement or in affilia- 
^tion-. for sch/^l (Table 2). " ' ^ , 

• Conclusions' •''j* " ' ' * 

The failure of 'the-test scores to demonstrate, any praject impact' is not 
altogether surprising, given the |ery short duration of instruction. Less formal 
indications -are. .however, that'sorfie meaningful benefit was incurred as a result 
of the project. Teachers gained experience in remedial instruction aj^.team'" 
teaching, and expressed interest tn continuing the pi^pjept once the problems were 
resolved. One might reasonably speculate thfft." given this kind of attitude ^ 
among staff, such a project wouldjield greater-fruits if its duration were 
increased. ' • ; ' 

. \ 
St> Charles Parish 

'\ 

Description and Pro cess * . " • 

~- . • ' / ■ ' - • ' • 

The pilot^rojecV^raplenientec! by St.'CharTes Parish represented an experiment 
in the use of computer-assisted, instruction (CAI) in mathematics. Specifically. ^ 
the CAI strategy employed was -designed primarily to affof'd participating students. 
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extra practice in compufationaT^i lis. 

A half-time co- teacher and an aide were eiSployed in each of two schools 
to supervise a minimum of two weekly sessions per child in CAI. Reg<ilar class- 
room teachers attempted .to coordinate bath schedules and instruction with the 
project staff. 

One hundred and eighteen experimental and U3 control students were 
selected for ihvolvement on $he basis of prior test scores and teacher recommen- 
dations.. The matchi;ig of the two groups was not entirely successful: pretest 
math scqres were significantly higher among experimental "than among control 
students. -and the experimental group was comprised c?f. significantly more b>acks 
and significantly fewer Title I students than was the control group. The full 
'implications of these disparities are difficult tp deteriiine. One can say only 
that inferences based on data analysis should be interpreted with caution. - 
since the Statistical procedures rgst on the assumption that experimental' 
versus control group differences are due to random fluctuations. 

The project wa^ampered by a late start, for two reasons. First, notifi- 
cation of funding frbm the State Depar*tment of Education was' not received until 
after th^ school year had begun.. At that point, it was difficult to secure the 
equipment and qualified personnel required. Second, further delays in. the 
acquisition of computer'software packages were experienced. Thus, the actual 
instriiction^did not begin until late January. The instruction time. then, was 
only 'four months. ° ' . • 

Of the two e;(perimental classrooms, one waKof the open type and the other 
was traditional injayo^it and organization. In the former case, installing and 
i^s^ing the computer equipment proved easy an^ non-disruptive. In the laUer case 
it was necessary to move 'participants to another room for their CAI, and this 
proved somewhat disruptive. 
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Through the use of questionnaires administered tp both staff and parents, 
it was learned that "the level of approval was high among both groups, and 
informal -observation indicated that the students themselves typically found 
the CAI enjoyaUle and stimulating. . , ^ 



'Outcome 



Results of data analysis indicate that -the experimental group showed statist- 
cally significant gains relative to the. control group and that these gains were 
of sufficient magnitu(Je to be considered educationally meaningful. It mi^^t be 
recalled, however.. tha*=:these results should be interpreted with caut^n for the 
reasons discussed above. No significant gains were found with respect \o* the 
School Affiliation score of^the SOS test (Table 2). • 

-Cgnclusions ^ 

Despite some moderately serious delays in implementation and problems with 
students' allocation' to experimental and control groups, the outcome of this 
experiment appears encouraging. The gains observed in the short period ^f instruc- 
tion were of , sufficient magnitude to suggest that CAI in mathematics for a 
po£ulation of high-risk second-graders is^ an idea worth pursuing in greater depth 
and scope. ' . * 

■ - St. John The Baptist Parish * ? 

Description and Process 

. The pilot project implemented by St. John the Baptist Parish was dubbed • / 
"Prbject RIVER ( Remediated Instruction as Vit^lto fleet Educational Require- 
ments)." The.^ject emplbyed two co-teachers to provide .individual ized ^instruc- 
tion to selected students in reading, mathematics, and writing. j 

• ^udents were selected on the basis of teacher reconmendations and previous 
scores-on the Califorhia Achievement Test and the Ginn 720 Reading Placement^est. 
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Thdy were not randomly allocated to experimental and controT status. Rather/ 
experimental students were selected from'schools designated as experimental 
schools, and control students were selected from schools designated as control 
schools. An effort was made to match the experimental and con£ro-{ groups on 
the basis of overall <lemographic characteristics and test scores. 

In fact.this effort to produce matched gVoups for comparison was ]ess 
than successful. Experimental students scored significantly lower on reading, 
language, and mathematics pretests than did control group students. Moreover, 
the experimental group contained significantly larger proportions of Title I 
tudents, retainees, and recipients of free lunches ( titfe latter beino a good 
proxy measure of socioeconomic status). The analytical problems caused by 
these discrepancies -- and the responses to these problems - will be addressed 
below. ^ 

Considerable effort w* expended by project personnel to evaluate the 
process of implementation.^ Qijestionnaires were distributed to an'd completed 
by parents, teachers, principals and participating students. The results of 
these questionnaires generally indicate a "favorable response from all groups. 
It should be noted, however, that since control students and the parents anti 
professionals associated with them were not polled, it is difficult to evaluate 
the significance of these questionnaires. 

Outcome . • , . 

Analysis of a^dj^us ted gain scores revealed small, nonsignificant gains 
in reading, mathematics, and language. No significant findings emerged with 
respect to school affiliation (Table 2). , ' • ^ 



Conclusions 

The fact that no statistically significant effects emerged does not, of 
course, speak well for the. impact of this project. The fact that scores did 
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Hse slightly in ^11 three skill areas, however, may be an indication that 
the project was beginning to take hold at the time^of posttesting. 'it should 
-be recalled that ttie experimental group initially was characterized by lower . 
achievement scored prioVto the implementation of the project. It is possible, 
then, that the experimental students were 'slower learners than the controls. and 
that the gains they achieved would have proven more significant had they been 
contrasted with those of a more carefully matched control group. ' 

St. Landry Parish 

Description and Process 



The pilot project implemented by St. •Landry Parish was^ designed to provide 
high-risk students with remedial services by the addition of certified teachers 
^ to the regular classroom setting. Three experienced teachers provided individ- 
ualized instruction to 130 students identified by teachers as" having deficiencies 
i" reading or mathematics. Control students numbered 107. 

^the matching of experimental and contro,l students was successful: No ■ 
large disparities between the two groups existed prior to the beginning of the ^ 
project. 

A project coordinator and one instructor were ^empl^oyed in November. The ' 
.second instructor was not eng^etf i^ptiKearly in January, because of severe 
"difficulty experienced in "^ocating a replacement to take over instruction of her 
regular>:lassroom. A series of inservice training workshops was. conducted to 
f^iltarize thel\;aff with the objectives of the program and to encourage coordi- 
nation of efforts between added and regular teachers. In addition, a'^nd throughout 
the remainder o^ the school year, the staff met weekly wjth the Title I learning 
cen-ter teachers for additional consultation and coordination. 

Instruction began in early January. malJing for an instructional period of 
only four months. Diagnostic-prescriptive i^ntories were maintained for each 
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'experimetital group student,, and token awards and certificates were meted 
out to stuflepts as they demonstrated mastery of skill clusters. ^'During this 

"^period, parent-^acher, Conferences^were held monthly. Roughly half the parents 
r-invited attended these conferences, and questionnaires indicated that their 
response to the project was very favorable. Simila^questionnaires completed 
by teachers and project staff members yielded equally positive responses. Onsite 
discussions with and observations of teachers supported the results of the 
questionnaiif-e.^ Enthusiasm appeared ve'ry high, althoyg^i considerable frustration 

.was evident as a consequence of having to address so many deficiencies in so 

sliort a time period. 
♦ 



. Outcome . . 
... Data analysis revealed no significant project effects on any dimension, 
though the adjusted achievement gains of the experimental group were slightly 
greater than those of the control group (Table 2). . ' . 

Concllisio ns . • . ^ " 

Frpgi air appearances, this project was well -conceived and well-executed. 
Because of 'l-ate notifica.tion from the state'and a local shortage of qualified 
personnel, the project was hampered by a late start. -Although objective measures 
failed- tQ validate the meri-ts of this project, the Subjective and anecdotal 
.evidence suggests that the concept has promise. 

. "■ . ' Tangipahoa Parish 

. Description •■and Process « • 

^ TheKlot project ^ Tangipahoa Partsh was called DRILL. \^s aim was to 
provide remedial instruction fof higti^risk second-'graders through daily individ- 
ualized instruction in 'language arts and mathematies. 



students were selected fQr eligiBility on th6 basis of low prior test 
scoresi prior grade retention, and teacher recommendation. Of these, 72 were 
allocated to the experimental group and 62 to the control group. The alloca- 
tion was not random in effect: pretest achievement scores were lower among • 
experimental than among control students, and the experimental group contained 
fewer prior repeaters and fewer students served by Title r. These disparities 
in the composition of the t^o groups indicate that analyses of project impact ' 
be interpreted with caution, since any relative gains found could be attributabl 
to prior differences between the gorups. as, opposed to the impact of the • 
instructional' process'. 

The experimental students were served by three itinerant teachers trained' 
in the use of an instructional system called DYSTAR. marketed commercially 
by Science Research Associates. Although, project staff was initially impressed 
- by the promise of DYSTAR. it was soon evident that, serious problems were 
developing in its use. DYSTAR is. above all. a sequential curriculum. That is. 
every student must begin at^the same point and progress through the sanie stage's - 
in the curriculum.-, The concept may be sound, in that every lesson is predicated 
on student understanding of prior lessons. In practice, however, it proved " 
awkward. Most of the students jn the project were achieving at a level signifi- 
cantly higher than the start-off point of the1)YSTAR materials. Teachers were 
compelled to restrain their natural desire to skim or skip lessons until ..a 
student^'s abilities were well-matched with the l*^el of difficulty of a lesson. 
According to the project supervisor, this cau$ed\o?i^iderable frustration on^"^ 
the pan of both teachers^ and. students, and also retarded the process of 
addressing the deficiencies most apparent to the teachers. 

Upon recognition of this problem, the project director 'decided to abandon 
some of the stringencies of DYSTAR and to concentrat'e on usin^ the periods, of 
individual instruction to her best advantage by'aWessing defib'encies' as they 
were discovered. - .f ' 
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The project's development was hampered by aHa'te start whicfl in itself 
worked -to its disadvantage. The late start was compounded by. the= ihabiHty • 
of the project staff to secure instructional materials of appropriate diffficulty 
for the sample of students being served. Because of late notifica<tion of 
funding by the^LSDE. the project director was required to purqhase .the materials 
before thestudents had been selected and evaluated. By the time the problen^ 
was recognised, it was too late to acquire a different set .of materials. 

The- reactions of teachers and parents were solicited through question- 
naires, but the actual-results were not reported. Selected consents that were 
included in the project'^' report suggest that teachers' reactions were mixed, 
and that; parents were generally supportive of Jthis or any attempt to further • 
aid their children. ' ^ • 

■ - # 



Outcome 



Data an^ysis indicated that, relative to the control students, treatment, 
students Showed statistically aig^ificarit gain's in reading but not in mathematics. 
A nonsignificant loss occurred in school ^affiliation. Again, these 'findings ' 
must be interpreted Si th caution, for the reasons discussed above (Table 2). 

Conglusions ■ . \ 

^ . This is dearly a case wherein the true merit of the project has not been 
assessed. sincXit was not implemented to the full, extent proposed., The sugges- 
tion was that gainKin reading were achieved, but these results require replica- 
tion. ^ The problems experienced ;Coul^ be attributable to the novelty of the ' 
instructional program, but 'it is the opinion of the Program Evaluator that ' 
earlier notification of state support might have allowed project personnel the 
necessary time to evaluate" properly both the defY:iencies of the s'tudents and ' ' 
the level of the materials, in order -best to match the two.- 
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" ^ , West Carroll Parish 

Description and Process ^ " 

The West Carroll pilot project^was dubbed. "Mathematics Achievement* 
Growth In Comput.ationaT Skills (MAGICS)." The project made use of a^puter- 
••ized instructional .management system to diagnose and prescribe remedial ser^^ces 
• for second-grArs who^xhibited marked deficiencies in computational' skills. 
The system iifcluded an online- component as well through which students could 
receiye practice and symbolic reinforcement in computation at their optimal' level/ - 
.of difficulty. , * 

Unlike the pther projects involving computers, this project aj/loyed a 
minidomputer. -as opposed to a .tiicrocomputer. - .The power of minicomputers" is 
considerably greater, and the software more flexible and sophisiticated than 
- that currently available with microcomputers. ' ^ 

Althou^iJ the computer l)erf9nned most of the work nfecessary to customize . 
drills and reports to students, t^e classroom teacher was always in control. That 
is. she bould alter or override thejdictates of the computer at will. " >0n the basis 
of observation and discussion, it became apparent to the Program Evaluator that . 
th'is flexibility has several important .advantages. F,irst. the teacher, unlike 
the computer, can consider Various intangib-le factors in additiofi to a student's 
.current level of achievement. She is sensitive to a child',s mood on a given day.^ 
and may be inclined to provide problems at a- lower or higher level of difficulty ' 
.than is Veconniended by the computer. This woai,d seem to have the potential to 
. make the custom-tailoring process even more finely tuned, Second, affording 

the teacher the power and responsibility tb override, the decisions ^f the 
-computer has the effect of. restoring some of the teacher's sense of efficacy ^ 
which is. easilV undermin^d_by^«n-inflexV^l|j^ , '-^ 

'Experimental students (113) and Control students (46) were selected on . 
the basis of pre^-ious mathematics achievement scores below the 50th percentile. 
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The groups were fairly well-matched, with the exception that the experi- 
mental group performed slightly better on the pretest and contained a signifi- 
• "cantly higher proportion of black students than did the control group. 

Because of-late notification of fundi%, the computer equipment was n^ 
ordered until late-September, and was noi. operational ur\jtn. early January. Two 
weeks of training followed, and actual implementation began in mid- January. 
As posttesting was conducted in mid-May, tfie instructional period .vflected k\ 
the pretest-posttest comparisons was only four months in duration. 

Informal surveys were conducted with students, >staff, and parents, and 
the reactions are rep^^ed to have been uniformly positive. The Program 
Evaluator's onsite' observations supported the contention that the system was 
working smoothly and that teacher and principal support'was afa higft level. 

Outcome 

Data analysis revealed that the adjusted gain scores -of the experimental ' 
group significantly exceeded those of the control group. No significant differ- 
ences were found in school affiliation (Table 2). Thus, evidence of the efficacy 
of-^ pr6ject is not lacking, despite the shortness of the instructional period. 

Conclusions ^ 
" — 

The computerized instruction and instructional management system appears 
to have operated effectively. One concern held by the Program Evaluator was tba^ 
the system was far more expensive than those" using m'lcrocomputej-s. Thus, the 
cost of the system per pupil served was high. Fortunately, such a system cart 
accomodate more students than were served in the pvQ^t. MoreoverS, this 
can be achieved without lowering the pupil-terminal ratio, since a minicomputer 
Of this^type can.accomodafe many terminals at distant physical locations. ^ 
sum, there is reason to believfi that the effectiveness of this system may' be^^ 
enhanced by lengthening the .instructional period, and that its cost-effectiveness 



may be increased by increasing- the number of sites with terminals. ' 

s . North Louisiana Consortium For Education < ' 

^ (Ouachita Parish School System, Agent) 

Description and Process ♦ ' ' 

The North Louisiana Consortium for Education represents 20 public ^ 
. school systems and one parochial school system in the Fifth Congressional Districl; 
of North Louisiana. The Consortium's pilot project consisted of two components^: 
l)-the addition of certified remedial teachers to existing classrooms., and 2) the 
implementation of a transition class for students at risk far retention. Both 
components served second-graders who had previously been retained at least orfce. . 

- Component One. involving additibn of certified teachers, was implemented 
in P^achita Parish and in Lasal^.^Parish. Each remedial teacher was assigned. 
. to work iW'th students in at least two classrooms in small groups. Efforts 
were. made to coordinate these sessions* with the overall schedules of the regular 
classroom teachers, and with other personnel including those in Title I and 
special education. ' ^ ^ 

The 102 students selected for compens^ory/ remedial services were those 
in the target school who were at highest risk for retention. S^fdents were not. • 
/ however. 'allocated at random to experimental and control groups, nor were schools 
selected through random assignment. In fact, pretest scores Indicated that 
experimental group students averaged |ign1ficantljr' lower initial scores in reading." 
and slightly lower scores in mathematics than ^ did the control group students. 
Therefore, .the 'results of the outcome analyses should be interpreted with caution. 

-Despite the specifications i'n.the Consortium's proposal, project personnel 
decided to alter* somewhatThe operation of ' the component in Usalle Parish. 

P * P 9 tudents resided in five classrooms, the additional teachers 
were j-nitialTy requiVed to overextend themselves, such that. they could work^with 
students In eac^classroom onl^^ one hour per .day. The project director decided. 
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therefore, that those students demonstrating the greatest need from all five 
classrooms would be" removed to another poom for three hours per day for com- 
pensatory/remedial instruction. In other words, all participating students 
received, at least one hour of special instruction, and some received th^ee ' 
hours in a separate room. 

.Component Two, the transitional ass, was offered in Caldwell Parish. The 
primary objective of this component was to give slower .students an opportunity 
tff "catch up" to the-grade level to which they were putatively to be promoted, 
by providing them with intensive compensatory/ remedial instruction. In this 
way,, it Was hoped that the subsequent class of third grader^ -would be more 
homogeneous with respect to abifity level, and that third grade teachers' could 
be more effective in teaching ^children more nearly equal- in ability. Project 
developers expressed the belief that^ transition class concept might be an 
option preferable to retention. ^ ■ • " 

ftrticipating students received compensatory/ remedial instruStton for a 
full day, every day, in grouf)s whose pupil -teacher' ratio wasoi&°t6* L 

The Consortium project, ;like most others, was plagued mjs/ severely by 
,a late start, which in turn was caused by iSe notification otfunding by the 
LSDE. The late start made particularly difficult the tasks of. hiring and ■ ^ 
•reassigning teachers,. aVlocating and scheduling teachers, and- students, and' 
acquiring curriculum ^upport materials. • 

».' * " ' 

Another problem'was caused by what was perceived as too htgh a. pupil -tea che 
ratio. The 'average number of;puf5ils per teacher was 17, whereas experience 
led both project^personnel and the Program Evaliiator to reconinend 8 to 12 pupils 
per teacher. . • " . ' 



Outcome ^ • \ 

— — — - . f. 

An analysis of adjusted ^ain scores -revealed that the Component One experi. 

mentaT group demonstrated significant gains in mathematics bL:t not irfVeading.. 



Component Two (transition class) experimental students showed measurable gains 
relative to controls, but because only one class was involved, the numbers were 
insufficient for the gains to achieve^statistical significance. No differences 
were found with respect to scho'ol affiliation in either component (Table 2). 



Oonci usions 

The finding of gains in mathematics (and nonsignificant gains in reading) 
suggests -the possibility that the project was beginning'to have a measurable impact' 
at the time of postte'sting. The short duration of the instructional period in 
Component One. coupled with a high 'pupil -teacher ratio, were likely the primary' 
.reasons for the marginal success of this project. Conponent Two sho^/ed promise, 
but the number of children involved was too small for significant results to be ^ 



detected. Were these conditions remedied. ''there is reason to believe that 
results would be considerably more positive. 
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DEMONSq'RATION PROdECTS. ' • . 
Ascension Parish 

Description and Process 

The demonstration project implemented in Ascension Parish represented an 

. attempt to demonstrate the impact of a computer-ass.isted management system in 
two instructional resourte centers. 'The skills addressed were reading and 
language arts. The object was to demonstrate a system that would incorporate 
the state minimum standards, the basal reading text, and the existing instruc- 

. tiond system. Ideally, a computer-assisted management' sys tin would enable 
tbese^thre6 components to be efficientl^^coordinated within thte corpus of, a 
sing.le curriculum. * - 

The specific functions of the resource cneters would be to identify students 
in need of compensatory/ remedial services, to diagnose their' deficiencies\ and 
to prescibe instructional materials and strategies. V " 

V One hundred twelve students were selected for inclusion in the experimental . 
group, and 113 students in other schools were Selected to serve as controls.- In 
fact, the experimental group evidenced sOmewhat lower pretest scores inj;eading 
and language, and it contained more black-s. fewer Title, I students,^ more 
students receiving free lunch than did the_£Qntrol group. Because of these dis- 
parities, results-of data analysis should be interpreted -with caution. 

^The job of correlating existing materials, state minimum standards, *and 
student prescriptions is very time-comsuming when done by hand. . It is for -this - 
reason that microcomputers were proposed to pePfqrm.much of this- work, leaving the 

' teachers free to deyote their full attention to instruction. However, it was 



this componen^of the project that proved most trou^esome. Compounding the 

delay 'caused by late notification of funding were further delays in the acquisi 

. tion and setup of the computers.,' Most serious was the fact that obvious mis- 

^ matches occurred between the prescriptions generated «by the computers' 

, , and^resources actually available in the resource centers. In other words. 

\ / . insufficient attention was giverv^at the outset to the need to'custom-tailor 

the management system to an existing resource center. » 

J ' ' AccordiJgno resource center teachers.^ some of them attempted to 

^ accomodate the computer-generated prescriptions, while, most simply abandoned 

the use of the computer foY all ^iut the^st trivial tasks^uch as generating 

printouts of group performance. There are plans to introcS better-matched 

software into the computers for" use during a planned summer session. 

Despite (or. perhaps, because of) the difficuVties with the computers, the 

resolve of the^ participating teachers'was striking Their morale was high, and 

SO. too, was thaf-oT the students'. Informal -observation indicated that the 
»^ # , > < ■ ■ ' ' , 

- students .were sifending a very high proportion of their time in- the-penters on 

.task-,; The^tl/chers ;^ere /atherHoeal about- their frustrations and freely voU 
unteered sugg^estioRS a_s .toShov^ the/system migKt be improved. A planned sunnier " 
session ma^ w^ll be a better test of, the' vfability of the system as it was meant 
- " to be implemented. 
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Outcome ' ^ 



. Data analysis revealed thatjs^gnificant gains were achieved by the experi- 
mental .group in both reading and language. ;No s'ignlficnat gains were found with 
respect to school affiliation (Table 2).AThese resu^Us should be replicated with 
groups more carefully matched before any firm inferences' are drawn. ' 



Conclusions 



1 

This dpmonstratiop project" was ambitious aad quite comply. Its execution 
was flawed, primarily (because of insufficient leahtme in which to properly" 



match a classroom mangement system with existing practices and resources." 
Nevert/he.leas; the results suggest that.stu^n'ts-di^^benefit from the experi- 
- ence of inteorfve instruction in the resource rooms, and one can only speculate 
that a more efficient computer-assisted system might well engender significant 
improvements in the effectiveness of the resource centers. 

St. Bernard Parish 

Description and Process > ' - " 

The demonstration' project implemented by St. Bernard F^rish was dubbed 
"Project competency." In addition to the goal' of fostering student achievenfent 
and attitudes toward. school . this project aimed explicitly to assist students in 
•the'basic skill areas of reading, .writing. *and mathematics, as demonstrated' by 
mastery of the state minimum competencies. 

The project employed three certi^ed teachers, one specializing in each of^ 
'the three skill ar^s, to work with selected students in the classroom during 
regular cl^ss periods. The three teachers "Were itinerant, moving from one 
school to another according to a prearranged schedule. In this way, the three 
.teachers were able to pro^vide remedial services to 75 needy students, and each 
.group of eligible students-^heeeived the same number of hours of remediation in 
a giyen week. \ ' 

The remediatidn provided can best be described as diagnostic/prescriptive. 
For each participating studertt'an Individual Remedial Prescription (IRP) was 
prepared by the project teachers, i a .cooperation with the regular classropm' 
teachers, the IRPs identified in detail the particular mastery objectives on > 
which.each student was currently working, the materials used for remediation 
with each student, and the progress niada by the student over*time. 

'students were deemed eligible for the project on the basis .of previous • 
standardized test scores, teacher-assigned 'grad^s\ and teacher recommendation^? 
Once eligibility had been determined, the eligible students were divided into'^ 
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two group! 
students 
groups as 
factors. 



signified 
alike on 
The grdup 
proportion 
In ,a 



X 



representing a treatment and a control group. The allocation of 
the two groups was done in such a'lianner as to render the resulting 
similar as possible with respect to a.varie'ty of j6<rtWionally relevan 
lliis effort was quite successful, as evidenced bythe faKthal? the 



average pretest achievement and SOS scores of the two groups did not differ 



rtly. 4treover, the demographic profiles of the two groups were 
<n dimensions except the proportion of students^ served by Title I. 

designatedJ^or remedial instruction included a -significantly snaller 

• ^ "A ^ 
of Title I students than did the contro.l group. 



Idition^o the renredial .services provided directly to students, the 
project h id .two secondary objectives: inservice training of the itinerant 
teachers )y outside consultants, and parent-teacher workshops intended to pro- 
mote reinforcement at hbme\of the learning activities taking place in school. 
These activities in fact tcpk place, but no documentation was provided by St. 
Bernard f^rish regaining th,^ impact of the activities. 



outcome 



Analysis of adjusted ^ 



reading but not in mathemati 
affiliation (Table 2). 



in scores revealed small, non-significartt gains in 



both groups with the experimental group. shovHng slightly greater gaihs in. 



cs. No significant differences were found in school 



Conclusions 

The implementation of Ithe project, like that of most of the others, was 
constrained by an insufficient, period during which to prepare an overall plan 
of action, to solve the corfe^iderable problems attendant to the scheduling of " 

traln.the itinerant teachers in the application of * 



itinerant teachers, and \o 



diagnostic/prescriptive techniques to the teaching of state. minimum standard)^^ 
Given the non-significant, tr<end in the direction of positive impact, it 1s ( 
possible that- the true merit of the project would show itself, were the project 
repl'cated wj^h adequate lead time and implementation time. 
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, , OVEfALL SUMMARY AND CONCLUSIONS 
Planning Pro.iect " * ^ * 

The two projects approved for, planning and training of personnel" were the ^ 
msot difficult to evaluate in upbjective manner, because of the paucity of 
verifiable and quantifiable 'data. Astuch, the discussions above emphasize the 
degree to whieh stated goals appear to have been achieved on the basis of formal 
and informal observations. In both cases (East Baton Rouge and the Consortium), . 
the projects received high marks ^ on this criterion. In fact, it appears that 
tfies^projects excelled in precisely that area in which deficiencies tended to 
exist. in the other. projects: adequate planning and training. This suggests the 
argument that, in the future, it may be wise. to allow projects to engage in a . * 
year of planning and training- priori the implementation of a pilot project. ' 
It is the opinion of the Program Eyalua tor .that both planning projects are well- 
prepared to initiate pilot projects, and that such projects, were they .Imple- • 
mented. would be unlikely to suffer- from- the" effects of severe delays experience'dj 
by the other projects. . ' , . * ^ = 

- «. 

ft ' - 

Pilot and Demonstration B-ro;iects - 

't ' ■ , 

Seven of the 15 projects in these categorie^^ demonstrated at least 
suggestive positive effects on student achievement in oneor jj^re skill areas. 
Of thep,%even,'^ five evidenced significant gains in al.l^jjj^achievement ^skill 
areas addressed and tested. No evidence was found that students' e^ffiliation 
for school, as' assessed by the SOS, was affected by any of the projects (Tablet). 
There is no obviou^eason^or the failure of the SOS" to detect any improvement 
In students' attitudi? toward sjchoov; One possibility is that attitudes simply 
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expect^jto change in a short period of time, evert in cases where ^ 
■ achievement gains a.re found. Another possibility is .that 'tir'instrument itself 
lacks. vali(iity vyith the particular sample of loW-achfeving studentF'invol ved in 

these projects'. . ' ^ ^ * • ' : 

f— > I . 

- ^ At .the outset^/ this program the Program Evalliator made plans to assess 
the cost-effectiveness_^^f each project. particularly.:.those funded for -demo rfstra-. 
, tion. These plans were abandoned*hen it became clear that virtually all the 
•projects had been seriously hampered by significant dela^^*in implementation!-' 
^bny.of the projects were simply not able, in the time permitted, to make optimal 
use of th6 funds allocated to them/ The varian^ce in .instructional time among 
projects further complicate<l the situation, to the extent that a. cost-effective- 
ne^s analysis was no^ longer deemed useful or statistically valid. 

^ Overall, results suggest that the flexibility built in to the Request for 
'Proposals had a favorable influence. If all^he projegbs iiad beenVequired to 
pilot or demonstrate the, same instructional model, one would have learned some- 
thing. about the ability of'each parish to iiihpl.ement it successfully, butj"ittle 
about the merits of the- chosen rflodel . By encouraging diversity among models, 
both the LSDE and the participating parishes have acquired valuable info rma tion" 
about the relative merits and feasibility of a. number ,of models. 

With the exception of West Carroll, those par«^es that experimented with 
computer-assisted techni-ques-experienced'a common core of difficulties. It 
appears that the stateof the art in the usfe of microcomputers in classrooms is 
not .quite adequate for smooth' operation. It should' be noted, however, that many 
commercial concerns are working very rapfdfy to improve this situation, and it 
may be only a year or two before dramatic improvements have been ach.ieved. 

Most of the projects that emphasized individualized instruction showed 
promising remits.. Most of these projects combined the lowering of pupil-teacher 
ratios with the in^itution of diagnostic/prescriptive instructional techniques. 
While It is not. clear which (if either) of these twd components is the more 
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potent, their combination seemr to hold promise for the remediation of high-risk 
'.secant-graders, and further testing of these models.is clearly warranted. 

Certainly the clearest lesson learned was that compensatory/remedial educa- 
tion programs cannot be expected to function at optima] effectiveness when 
implementation does not begin until January or February of the school year.- 
Although some projects can be fai^lted for delays, all of them were handicapped 
from the outset by the fact that they did not haye thetr funding approved -until 
after the beginning of the school year. Without exception, local project ' J 
•directors cited late notification as the single most vexing problem they experi- 
enced. If state funding is to be forthcoming in future efforts of' this kind, >t 
is .imperative that notification of funding be given at least one month prior to 
the beginning of the school year. 
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